Description

Add submit_option to the cluster configuration. These submit options are passed in every submitted jobs.

Motivation and context

Delta and Frontier both have --constraints flags that should (almost) always be set. I set these values by default. In most cases, setting these constraints have no undesirable side effects. In cases where they are a problem, users can override the setting with action specific submit_options or a custom clusters.toml.

How has this been tested?

Validation tests pass on Delta and Frontier. Unit tests ensure that the new submit_options behaves correctly.

Checklist:

• I have reviewed the Contributor Guidelines.
• I agree with the terms of the Row Contributor Agreement.
• My name is on the list of contributors (doc/src/contributors.md) in the pull request source branch.
• I have added a change log entry to doc/src/release-notes.md.